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1.  Introduction 

We  present  an  algorithm  for  formulating  the  narrowband  (or 
target)  tracking  problem  as  a  Markov  Random  Field  (MRF) 
with  discrete  and  continous-valued  hidden  state  variables.  We 
then  derive  a  simplified  algorithm  to  estimate  the  model  state 
variables.  An  MRF  exists  whenever  there  is  a  collection  of 
sites  that  statistically  interact  with  their  neighbors.  This  re¬ 
quires  defining  a  neighborhood  system  for  determining  which 
sites  are  the  neighboring  sites  -  such  as  a  distance  metric.  If 
the  Markov  property  is  met,  then  if  we  are  trying  to  make 
statistical  inference  about  a  given  site,  knowledge  of  all  the 
sites  is  no  better  than  knowledge  of  the  state  variables  of  only 
the  neighboring  sites. 

In  the  narrowband  tracking  problem,  we  assume  we  have 
detected  a  number  of  “interesting  sites”  in  a  spectrogram. 
These  ’’interesting  sites”  are  regions  where  there  appears  to  be 
straight-line  motion  of  a  narrowband  signal,  perhaps  detected 
by  the  application  of  a  radon  transform.  Each  site  n  has  a 
measurement  of  center  frequency,  /„,  frequency  rate  rn,  and 
amplitude  an.  We  seek  to  make  “soft”  connections  between 
the  interesting  sites  so  as  to  make  longer  tracks.  We  apply  a 
linear  dynamical  model,  to  explain  the  behaviour  of  the  target. 
This  is  identical  in  formulation  to  a  Kalman  filter,  with  the 
exception  that  the  state  transition  matrix  is  many-to-one  (many 
neighbor  sites  to  a  single  site).  The  method  is  generalizable 
to  any  tracking  problem. 

II.  Generic  Algorithm 
A.  Basic  Notation  and  Goal 

Let  there  be  L  “interesting  sites”  and  suppose  that  at 
each  site  n  we  have  a  measurement  x„  =  [fn,fn,  ctn)1  ■ 
Let  X  =  [xi,X2...xl]  be  all  of  the  data.  Let  Nn  be  the 
number  of  neighbors  of  site  n  based  on  some  a  symmetric 
rule  for  determining  “neighborness”.  We  assume  that  there  is 
an  underlying  state  at  each  site  which  we  cannot  observe,  but 
can  estimate.  The  state  consists  of  a  discrete  state  variable 
1  <  s n  <  P,  and  a  continuous  state  variable  0 ,,  £  W .  In  the 
narrowband  tracking  problem,  the  discrete  state  s„  takes  on  a 
value  from  1  to  4: 

1)  Internal  site  (having  both  a  left  and  right  association). 

2)  Left  terminal  site  (having  just  a  right  association). 


3)  Right  terminal  site  (having  just  a  left  association). 

4)  Noise  site  (not  associated  with  any  other  sites). 

Our  goal  is  to  determine  the  aposteriori  discrete  probabilities 
p(s„|X)  and  the  parameters  of  the  conditional  aposteriori 
continuous  PDF  p(0?l|sra,X)  at  each  site  n.  For  tractability, 
we  will  assume  p(On\sn,  X)  is  Gaussian  which  means  we  need 
only  find  the  conditional  means  and  covariances.  The  basis  of 
our  approach  is  the  Markov  property  and  the  construction  of 
the  conditional  probability  functions  (conditioned  on  knowing 
the  state  variables  of  the  neighnboring  sites)  thus  the  resulting 
estimates  are  the  estimates  of  a  Markov  random  field  (MRF). 
Our  method  does  not  approach  the  problem  as  a  Gibbs  field 
as  does  much  of  the  MRF  literature  to  date  [1].  Our  approach 
is  iterative  and  convergence  is  achieved  when  p(s„|X)  and 
p(^n|sn)X)  stop  changing.  To  start  the  iterative  algorithm, 
we  initialize  p(s„|X)  and  p(On\sni  X)  to  “generic”  values, 
then  design  an  algorithm  to  re-compute  the  same  quantities 
at  each  site  n  based  on  the  state  variables  of  the  neighboring 
sites  and  the  current  site’s  measurement  x„.  The  method  is 
related  to  dependency  networks  [2]  and  iterative  conditional 
modes  [3].  The  novelty  of  the  approach  is  the  calculation  of 
the  Markov  conditional  probability. 

B.  Simplified  Notation 

Because  in  the  discussion  below,  all  our  equations  have  to  do 
with  site  n,  we  simplify  the  notation  by  dropping  the  subscript 
n  and  use  i  to  represent  the  discrete  state  sn  thus: 

N  =  Nn, 

pn(0\i,X)=p(en\sn=i,X), 

Qn,i  —  P^Sn  —  ^|N), 


To  avoid  confusion,  we  use  the  symbol  (p;/  in  stead  of  6 
to  designate  the  continuous  state  variable  of  a  neighbor  site, 
where  1  <  j  <  N  runs  over  the  neighbor  sites  of  site  n. 
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C.  Single-State  Assumption  and  Expansion  over  Neighbor 
Configurations 

We  assume  that  neighboring  sites  can  be  either  associated 
(connected)  or  not.  For  each  configuration  of  associated  neigh¬ 
bor  sites  (by  “configuration”,  we  mean  how  many  connected 
neighbors  and  which  ones),  only  one  state  is  possible  at  site 
n.  We  call  this  the  “single  state”  assumption,  the  result  of 
which  is  that  as  we  enumerate  all  the  possible  combinations 
of  neighbor  states  and  “connectedness”,  we  find  that  the 
combinations  organize  themselves  into  disconnected  sets  that 
“support”  just  one  state  at  the  current  site. 

Let  the  variable  I\  represent  a  particular  association/state 
set.  By  this,  we  mean,  K  represents  a  choice  of  associated 
(connected)  neighbors  as  well  as  their  states.  Let  J  repre¬ 
sent  a  particular  combination  of  states  for  the  non-associated 
neighbors.  The  combination  {J,  A'}  therefore  specifies  which 
neighbors  are  “connected”  to  site  n,  their  states,  as  well  as  the 
states  of  all  the  neighbors  which  are  not  connected.  Having 
defined  K ,  J,  we  expand 

p(B,i  |X)  =  EE  p(G,i\K,J,X)p(K,J\X) 

K  J&Jk 

where  Jk  is  the  set  of  all  combinations  of  states  for  the 
neighbors  that  are  not  connected  under  configuration  K.  We 
need  not  consider  illegal  combinations  such  as  when  a  site 
has  two  “connected”  right  neighbors.  Because  the  states  of 
the  non-connected  neighbors  does  not  matter,  we  drop  the 
dependence  on  J  in  the  first  term: 

p(e,i\x)  =  EE  p(0,i\K,X.)  p(K,  J|X) 

K  JdJK 

We  now  divide  the  data  into  two  parts: 

X  =  {x,  X"}, 

where  X"  is  all  the  data  except  site  n.  We  expand  the  first 
term: 

p{9,i\K,X)  =  p(0,i\x,K,Xn) 


p(0.i,x|if,Xn) 

p(x|K,X”) 


p(0,i,*\K,X.n) 
{numerator} d6 

Expanding  the  numerator  and  plugging  in,  we  get 


p(9,i  |X) 


EE 

K  J£JK 


p(x.\9,i)  p(d\i,K,Xn )  p(i\K,J,Xn) 
{  numerator}  t/fl 


D.  Neighbor  continuous  State  Variables 

Let  us  expand  the  notion  of  neighbor  configuration  K  to 
include  the  continous  state  variable  of  the  neighbors,  denoted 
by  cp.  It  is  necessary  to  integrate  over  fi>.  Thus, 


p(<M|X)  =  E 


E 

xe/Ci  Je  JK 


0 


p(x.\G  ,i)  p(G\i,K,<fi.X.n) 

J'^  { numerator  \(W 


■p(K,  J,  0|X)  d(j> 


We  can  simplify  the  above  if  we  assume  that  the  PDF 
p(K,  J ,  0|X)  is  sharply  defined  in  <fi  as  compared  to 
p{G\i,  K,  </>,  X")  for  a  given  value  of  6.  This  assumption  is 
good  because  in  the  latter,  <f>  appears  only  as  a  conditional 
variable.  Then,  we  may  approximate  the  above  as 


p(MX) 


E  E 

KeiCi  JejK 


p(x.\0  j)  p(0\i,K,(J) K  ,Xn 
{ numerator  }d0 


■p(k,j,4>*k\x), 

where  <fi*K  is  the  estimate  of  <p  corresponding  to  neighbor 
configuration  K.  This  assumption  is  a  good  one  because 

E.  Gaussian  Assumption 

Assuming  there  is  zero-mean  Gaussian  measurement  noise, 
we  have 

p(x|0,  *)  =  A^(x  —  0 ,  C), 

where 

_/V(x,  C)  =  (27t)_p^2|C|-1^2  exp{— x,C_1x}. 

Let 

p(e\i,K,(f>*K,Xn)  =  N(Q  -  A4,F'RkF,  +  S4), 

where  R/<-  is  the  covariance  of  <fi*K  and  F(,  E,  are  the 
continuous  state  transition  matrix  and  the  plant  variance.  With 
these  Gaussian  assumptions, 

p(mx)=  E  E 

KeiCi  jgJk 


N(x-0,C )  N(6-Fi(t>*K  .F'RKF«+Si) 
{  numerator}  d9 


P(K,J  |X), 


We  now  drop  the  subscripts  and  superscripts  from 
F, .  Sj,  R.k  ■  4>k  f°r  simplicity.  Using  the  identy 


N(x  -  d ,  C)  N(6  -  Ffi ,  F'RF  +  S)  = 


■P{K,J  |X), 


Because  of  the  single-state  assumption,  for  a  particular  K, 
only  one  state  i  is  possible.  Thus,  p(i\K,  J ,  X")  =  1  for  K  £ 
K-i  where  )Ci  be  the  set  of  associations  that  give  rise  to  state 
i.  Then 


p{0,i  |X) 


E  E 

K^Ki  JGJk 


p(x|H.i)  p(0|i,it',Xn) 
{mnnera.tor \d(i 


N(x  —  F<j>,  F'RF  +  S  +  C)  N(d-uK,GK), 

where 

Gjf  =  (CU1  +  (F'RF  +  S)'1)^1  (1) 

uJf  =  G^(C-1x+(F'RF  +  S)-1F  0),  (2) 

and  carrying  out  the  integration  in  the  denominator  we  get 

P(9,i  IX)  =  E  E  N(G-uk,Gk)P(K,J\X ) 

Xe/Ci  JG  Jk 


■p(K,  J|X) 


1  2  3  4  5  6 

TIME 


Fig.  1.  Typical  narrowband  situation  showing  8  sites. 


This  can  be  re-written  as  a  Gaussian  mixture  of  the  form 

p(0,i\X)  =  akN(6 -uk,Gk)  p(i\X), 

_  k 

where  k  is  defined  as  the  pair  {K  £  )C  i,  J  £  Jk},  and  where 

P(*|X)=  ^  ^  P(K,J\X),  (3) 

KelCi  JGJk 

P(K,J\X) 
ak  Pd  IX)  ' 

Note  that  Ylkak  =  1-  To  get  a  meaningful  result,  we  need  to 
collapse  it  down  to  a  Gaussian  PDF.  The  mean  is: 

/r  y  ' 

i 

And 

£(xx')  =  ^2  Oii  [Gj  +  UjU-] 
i 

So  the  covariance  is 

£(xx')  -  mi!  =  ^2  ai  [Gt  +  uiu;]  -  w?  ■ 
i 

We  must  now  determine  how  to  get  an  expression  for 
P(K,  J |X). 

F.  Narrowband  Tracker  Application 

Refer  to  Figure  1  which  shows  a  typical  narrowband  (NB) 
situation.  Each  site  is  detected  from  a  spectrogram  and  comes 
with  a  measurement  of  amplitude  (SNR),  center  frequency, 
and  frequency  rate.  Local  frequency  rate  is  determined  by 
integration  of  the  spectrogram  along  short  lines  with  varying 
center  frequency  and  slope,  then  choosing  sites  which  are  local 
maxima  in  both  center  frequency  and  slope  and  exceed  some 
minimum  amplitude  threshold.  In  the  figure  are  shown  10  sites. 

In  Figure  2,  the  neighbor  sites  of  site  7  are  shown  inside  the 
circle.  We  define  a  neighbor  as  any  site  exactly  1  frame  away 
in  time  and  within  some  minimum  center  frequency  distance. 
A  neighbor  must  be  either  to  the  right  by  1  time  step  or  to  the 
left  by  one  time  step.  We  do  not  allow  a  neighbor  at  the  same 
time  step.  All  neighbors  must  be  mutual  neigbors,  i.e.,  a  site 


l 


Fig.  2.  Neighbors  of  site  7. 


that  has  a  neighbor  must  also  be  the  neighbor  of  that  site.  We 
assume  that  a  neighbor  can  be  either  related  or  unrelated  to 
site  n.  In  Figure  2,  site  6  is  probably  associated  with  site  4, 
and  not  with  site  7.  Sites  5  and  8  are  probably  associated  with 
site  7.  Site  9  is  probably  not  associated  with  any  other  sites. 

We  consider  four  possible  states  for  a  site. 

1)  sn  =  1  (Internal  site).  Internal  sites  are  connected  to  one 
left  neighbor  (internal  or  left  terminal  site)  and  one  right 
neighbor  (internal  or  right  terminal  site).  An  internal 
site  can  have  an  unlimited  number  of  unrelated  sites  as 
neigbors.  In  Figure  2,  sites  3, 4, 5, 7,  and  8  are  probably 
internal  sites. 

2)  sn  =  2  (left  terminal  site).  A  left  terminal  site  has  one 
neighboring  site  on  its  right  side.  In  Figure  2,  sites  1 
and  2  are  probably  left  terminal  sites. 

3)  sn  =  3  (right  terminal  site).  A  right  terminal  site  has 
one  neighboring  site  on  its  left  side.  In  Figure  2,  sites  6 
and  10  are  probably  right  terminal  sites. 

4)  sn  =  4  (Noise).  Noise  sites  are  independent  entities,  so 
there  is  no  statistical  relationship  between  the  amplitude, 
frequency,  or  frequency  rate  of  two  neighboring  noise 
states.  In  Figure  2,  site  9  is  probably  a  noise  site. 

Thus,  a  site  can  have  one  of  just  four  possible  states.  A 
neighbor  site  can  also  be  in  one  of  these  four  states,  but  can 
also  be  related  or  unrelated. 

G.  Expression  for  p(K,  J|X). 

We  now  develop  an  approximate  expression  for  p( K .  J|X). 
Let  F!im  be  a  measure  of  fit  from  site  n  to  site  m  given  site 
n  is  in  state  i.  This  measure  is  based  on  the  state  variable  at 
state  n  and  the  measurement  (not  the  state  variable)  at  site  to. 
We  could  use,  for  example 

K,rn  =  N(xm  -  FOl  F'R^F  +  S  +  C),  (4) 

where  { 0lri .  R)( }  are  the  estimated  state  variable  and  covari¬ 
ance  of  the  at  site  n  assuming  it  is  in  discrete  state  i,  i.e. 

p(en\sn  =  i,x)  =  N(en-ein,Rin). 

Recall  that  {K,.J}  designate  which  neighbors  are  connected 
(if  any),  their  states,  and  the  states  of  the  non-connected 
neighbors.  To  arrive  at  p(K,  JjX),  we  arrange  all  the  neigh¬ 
bors  of  site  n  into  left  neighbors  and  right  neighbors. 
Let  left  neighbors  be  designated  as  sites  A,  B,C . . .,  and 


right  neighbors  be  designated  as  sites  D,  E,  F . . ..  Let  the 
first  right  and  first  left  neighbor,  sites  A  and  D,  be  re¬ 
served  for  connected  neighbors  if  there  are  any.  So,  if 
K  specifies  any  connected  neighbors,  they  must  be  site 
A  and/or  D.  Let  {cA,cB,cc,  ■■■}  ,  {cd,ce,cf,  ■■■}  repre¬ 
sent  the  corresponding  associations  taking  values  of  0  (not 
connected)  or  1  (connected).  Clearly,  the  only  possibilities 
are  {cAlcBlcc,  ■■■}  =  {1,0,0,...}  or  {0,0,0,...}  ,  and 
{cd,  Ce,  cf,  •••}  =  {1,0,0,...}  or  {0,0,0,...}  .  We  use  the 
approximation 

p(K,J |X)  =  p(sa,ca)  p(sb,cb\ca)  p(sc,cc\ca,cb) 

•  p(sd,  cd)  p(se,  ce\cd )  p(sf,  cf\cd,  ce )■ 

The  notation  is  highly  symbolic.  For  example,  p{sA,cA )  is 
the  joint  probability  that  neighbor  site  A  has  state  sa  and 
connection  state  cA-  We  make  use  of  the  approximation  that 
if  A,  B  are  left  neighbors  competing  for  site  n,  p(sB,cB) 
depends  only  on  whether  site  A  is  connected  to  site  n  and  not 
on  which  state  it  has.  Thus, 


p(Sj 4,  CA,  SB,  CB)  =  p{sA,  Ca)  p(sB,CB\cA)- 

Furthermore,  our  expectations  at  site  C  are  not  changed  by 
knowing  the  states  at  sites  A  or  B,  once  we  specify  the 
connections  cA,cB  thus, 

p(sA,cA,sB,cB,sc,cc)  =p(sA,cA )  p(sB,cB\cA) 

■  p(sc,cc\cA,cB). 

We  assume  also  that  our  expectations  of  right  neighbors 
are  not  influenced  by  knowledge  of  left  neighbor  states  or 
connections.  This  is  clearly  not  true,  but  gives  us  a  workable 
approximation.  So,  we  treat  the  left  neighbors  independently 
in  the  same  way  as  the  right  neighbors.  Thus, 

p(sA,  CA,  SB,  CB ,  Sc,  Cc,  Sd,Cd,  Se,  Ce,  Sf,  Cf)  =  p{sA,  CA) 
•  p{sB,CB\cA)  p(sc,  Cc\cA,  CB)  p{sB,  Cd)  p(se,  Ce\cd) 

■  p(sf,  cf\cd,  ce)- 

The  functions  p(sA,cA)  and  p(sd,cd)  are  unique  because 
they  involve  the  sites  that  may  be  connected  to  site  n.  Consider 
the  function  p(sA,cA)  given  by 

SA  CA  p{sA,CA) _ 

1  1  p(sA)  a(A,  n,  sA) 

2  1  p(sA)  a(A,n,sA) 

3  1  0 

4  1  0 

1  0  p(sA)  /3(A,n,sA) 

2  0  p(sA ) 

3  0  0 

4  0  0 


where 


a(A,n, sA)  = 


T?SA 

* A,n 


where  k  runs  over  all  the  right  neighbors  of  left  neighbor 
site  A  which  must  include  site  n.  Clearly  a(A,n,  sA)  is  an 
approximation  of  the  probability  that  left  neighbor  A  connects 


to  site  n  given  it  is  in  state  sa  and  it  does  connect  to  a  right 
neighbor.  Also, 


0{A,n,  sA) 


which  is  an  approximation  of  the  probability  that  left  neighbor 
A  connects  to  a  right  neighbor  other  than  site  n  given  it  is 
in  state  s  4  and  it  does  connect  to  a  right  neighbor.  Logically, 
p(sA  =  {1  or  2},sa  =  0)  =  0  when  n  is  the  only  right 
neighbor  of  left  neighbor  site  A.  Tabulating  p{sB,  cB\cA), 


sB  cB  cA  p(sB,cB\cA) 


1 

1 

1 

0 

2 

1 
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3 

0 

0 
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4 

0 

0 

p{sb) 

where  p(sB)  is 

obtained  from  the  initial  state  probabilities 

Qb,sb ,  and  (3(B,n,sB)  represents  the  probability  that  left 
neighbor  B  connects  to  a  right  neighbor  other  than  site  n 
given  it  is  in  state  sB  and  given  it  does  connect  to  a  right 
neighbor.  Note  that  we  gave  set  p{sB,cB\cA)  =  0  whenever 
cB  =  1  because,  as  we  stated  before,  we  have  ordered  the 
left  neighbors  so  that  if  any  of  them  connect  to  site  n,  it  is 
site  A.  We  assume  that  given  sB  is  a  non-connected  state 
(3  or  4),  it  does  not  depend  on  cA,  although  in  principle 
knowing  cA  =  1  should  increase  the  likelihood  that  B  is 
in  a  non-connected  state  since  it  is  deprived  of  a  potential 
right  neighbor.  But  the  complications  are  many  and  payoff  is 
small.  The  expression  for  p(sc,  cc\cA,  cB)  must  enumerate 
all  combinations  of  cA,cB,  but  thanks  to  the  fact  that  we 
ordered  the  neighbors  so  that  only  site  A  can  connect,  we  find 
that  the  p(sc,  cc\cA,  cB)  may  be  evaluated  using  the  table 
for  p{sB,cB\cA)  by  substituting  C,sc,cc  for  B,s_b,c_b  and 
multiplying  by  the  function  S[cB  =  0]  which  is  one  whenever 
cB  =  0  and  zero  when  cB  =  1.  Additional  left  neighbors 
are  accomodated  in  a  similar  manner.  For  right  neighbors,  we 
repeat  the  tables  of  p(sA,cA)  and  p(sB,cB\cA)  substituting 
the  right  neighbor  sites  for  the  left  neighbor  sites. 


H.  Algorithm  Summary 
Given: 

1)  Measurements  xn  for  1  <  n  <  L. 


2)  Measurements  error  covariance  C.  You  may  use  site- 
dependent  (i.e.  SNR  dependent)  error  covariance  C„. 

3)  System  dynamical  model.  Let  9  be  the  state  variable  at 
a  site  corresponding  to  one  of  the  P  possible  states.  Let 
4>  be  the  collection  of  neighbor  state  variables  (either 
a  single  left  or  right  neighbor,  or  both  left  and  right 
neighbors)  corresponding  to  some  choice  of  neighbor 
state  combination.  We  assume  that  9  is  determined  from 
<p  according  to 

9  =  Ftp  +  w, 

where  w  is  a  Gaussian  RV  with  covariance  S.  Note  that 
F  and  S  will  depend  on  the  whether  there  is  a  single 
left  neighbor,  a  right  neighbor,  or  both  left  and  right 
neighbors. 

Initialization: 

1)  For  l<n<L,  1<*<P,  initialize  QUi„  and  the  mean 
and  covariances  of  p„(0|*,X),  denoted  by  9ln ,  R''(. 

Algorithm: 

1)  For  l<n<L,  l<m<L,  l<i<P  compute  the 
measure  of  fit  according  to  (4)  (note  this  is  a  sparse 
matrix  as  only  neighbor  pairs  need  be  considered). 

2)  For  each  1  <  n  <  L, 

a)  For  each  1  <  i  <  P, 

i)  Initialize  pln  =  0,  9n  =  0,  R''(  =  0, 

ii)  Determine  the  list  of  all  possible  choices  for 
associated  neighbors  of  site  n,  denoted  by  A, 
and  their  states,  denoted  by  Ja,  which  support 
state  i. 

iii)  For  each  combination  K  =  { A ,  Ja}, 

A)  Compute  G k,  u k  according  to  (1),  (2). 

B)  For  each  combination  J  of  states  of  the  non- 
associated  neighbors,  compute  p(K,  J|X) 
according  to  Section  II-G. 

C)  Let  wK  =  EjP(K,  J|X). 

D)  Accumulate  9  n  =  9n  +  w  k  u k 

E)  Accumulate  R^  =  TUn+WK{Gi< +ua'U^) 

iv)  Normalize  9n  =  9n/  wk- 

v)  Normalize  R‘t  =  Rj,/  wk  ~  °nK- 

vi)  Accumulate  pln=pln  +  wk- 

3)  Normalize  p;  =  — . 

2^iPi 

4)  Complete  iteration:  For  1  <  n  <  L, 

a)  Set  Qn,i  =  Pi, 

b)  Set  9ln  =  9,. 

c)  Set  RJj  =  Rj. 

5)  Go  to  top. 

I.  Interpretation  of  Results 

When  the  algorithm  converges,  it  is  necessary  to  interpret 
the  results.  What  one  has  after  convergence  are  estimates  of  the 
discrete  state  probabilities  of  each  site  as  well  as  a  continous- 
valued  state  variable  estimates  and  covariance  estimates  for 
each  site/state  combination.  One  also  has  the  fit  function 
F'n  rn  calculated  from  the  state  variables  and  covariances.  It  is 


necessary  to  search  the  graph  for  tracks.  One  way  to  search  the 
graph  is  to  locate  any  sites  with  high  probability  of  being  a  left 
terminal  site  (state  2),  then  find  the  most  likely  right  neighbor 
by  maximizing  Fln  m  over  the  indexes  m  corresponding  to 
right  neighbors,  then  continuing  to  the  right  until  a  probable 
right  terminal  site  is  found.  This  method  can  fail  if,  for 
example,  there  are  multiple  candidates  for  left  terminal  site  and 
the  probability  is  shared  among  them,  reducing  the  probability 
of  state  2  in  each  candidate.  Thus,  it  is  a  good  idea  to  also 
search  starting  at  the  right,  or  in  the  middle.  We  have  found 
the  best  approach  to  be  to  look  for  high  probabilities  of  state 
1  (internal  site),  then  follow  the  trail  both  left  and  right  until  a 
site  either  has  no  further  neighbor  or  it  has  a  high  probability 
of  being  a  noise  site  (state  4). 

III.  Simulation 

Simulated  data  was  created  by  adding  signal  to  a  30  by 
30  grid  of  exponentially-distributed  noise  with  mean  2.0.  The 
target  is  injected  by  adding  an  interpolated  function  using 
a  Gaussian  shape  of  variance  0.5  (in  the  vertical  direction) 
having  a  maximum  value  of  2.5.  Figure  3  shows  a  sample 
of  the  simulated  data  and  has  rejected  the  downward  branch 
to  sites  33,  42,  50.  On  the  right  panel,  the  true  target  track 
is  superimposed.  On  the  left  panel,  the  eye  has  a  difficult 
time  seeing  the  target  without  the  guide.  In  figure  4,  the 
output  detections  of  the  Hough  transform  are  shown.  For 
each  detection,  the  detection  (site)  number  is  printed.  The  site 
center  is  indicated  by  a  dot  and  the  slope  is  represnted  by  a 
line.  Notice  that  the  signal  track  is  clearly  visible  to  the  eye. 
However,  there  are  other  potential  tracks  as  well  as  interfering 
“branches”  that  may  cause  incorrect  results.  In  particular,  as 
the  target  track  proceeds  to  the  right  from  site  20  to  site  26,  it 
could  proceed  to  site  34,44,52,  or  it  branch  down  to  site  33, 
42,  and  50.  Figure  5  and  6  show  the  result  after  one  and  two 
iterations  of  the  MRF  algorithm.  The  target  track  is  beginning 
to  “crystalize”.  Those  sites  in  state  1  are  shown  as  blue  lines 
centered  on  the  time  location  of  the  site  (site  42  for  example). 
Those  sites  in  states  2  are  shown  as  green  lines  extending  to  the 
right  (site  33  for  example).  Those  sites  in  states  3  are  shown  as 
red  lines  extending  to  the  left  (site  50  for  example).  Noise  sites 
are  shown  as  magenta  circles.  Already  after  2  iterations,  the 
algorithm  has  apparently  settled  on  site  6  at  the  left  end.  On 
the  right  end,  there  is  a  possibility  that  the  target  ends  at  either 
sites  61  or  63.  Furthermore,  site  63  has  another  potential  left 
neighbor,  site  54,  which  is  unrelated  to  the  target.  In  figure 
7,  taken  after  50  iterations,  we  see  that  the  target  track  has 
straightened  out  considerably.  And,  the  algorithm  has  provided 
a  diplomatic  solution  to  the  right-end  dispute.  It  decided  that 
the  track  ends  at  site  52  after  all,  leaving  sites  54  and  63  free  to 
embrace  each  other,  and  letting  site  61  die.  This  is  apparently 
because  it  would  require  too  abrupt  a  maneuver  to  curve  down 
to  site  61,  and  site  63  preferred  to  go  with  site  52  anyway. 

In  trials,  there  was  a  70  percent  probability  of  success, 
measured  as  the  existance  of  a  track  with  the  correct  slope 
and  length,  within  some  bounds. 


Fig.  3.  Simulated  Data 


A.  Conclusion 

We  have  posed  the  target  tracking  problem  as  Markov 
Random  Field  (MRF).  However,  rather  than  working  with 
the  Gibbs  field  representation  of  an  MRF,  we  have  based 
the  algorithm  directly  on  the  probabilistic  expression  of  the 
Markov  property,  the  conditional  PDF  of  a  site’s  state  variable 
given  the  neightbor  state  variables  and  the  site  measurement. 
We  have  used  a  dynamical  model  akin  to  a  Kalman  filter  to 
model  the  target  dynamics.  The  algorithm  is  iterative.  By  using 
the  Gaussian  assumption  throughout,  we  obtain  a  simplifed 
and  efficient  algorithm.  We  demonstrated  the  algorithm  using 
synthetic  data. 


References 

[1]  S.  Geman  and  D.  Geman,  “Stochastic  relaxation,  gibbs  distributions, 
and  the  bayesian  restoration  of  images,”  IEEE  Transactions  on  Pattern 
Analysis  and  Machine  Intelligence,  no.  6,  p.  721741,  1984. 

[2]  D.  Heckerman,  D.  M.  Chickering,  C.  Meek,  R.  Rounthwaite,  and  C.  M. 
Kadie,  “Dependency  networks  for  inference,  collaborative  filtering,  and 
data  visualization,”  Journal  of  Machine  Learning  Research,  vol.  1,  pp.  49- 
75,  2000. 

[3]  J.  Besag,  “On  the  statistical  analysis  of  dirty  pictures,”  Journal  of  the 
Royal  Statistical  Society,  Series  B  ( Methodological ),  vol.  48,  no.  3, 
pp.”  259-302,  1986. 


Fig.  5.  After  iteration  1 


Fig.  6.  After  iteration  2 
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Fig.  7.  After  Iteration  50 


